US-based Sequential Algorithm Integrating an AI Model for Advanced Liver Fibrosis Screening.

Background Noninvasive tests can be used to screen patients with chronic liver disease for advanced liver fibrosis; however, the use of single tests may not be adequate. Purpose To construct sequential clinical algorithms that include a US deep learning (DL) model and compare their ability to predict advanced liver fibrosis with that of other noninvasive tests. Materials and Methods This retrospective study included adult patients with a history of chronic liver disease or unexplained abnormal liver function test results who underwent B-mode US of the liver between January 2014 and September 2022 at three health care facilities. A US-based DL network (FIB-Net) was trained on US images to predict whether the shear-wave elastography (SWE) value was 8.7 kPa or higher, indicative of advanced fibrosis. In the internal and external test sets, a two-step algorithm (Two-step#1) using the Fibrosis-4 Index (FIB-4) followed by FIB-Net and a three-step algorithm (Three-step#1) using FIB-4 followed by FIB-Net and SWE were used to simulate screening scenarios where liver stiffness measurements were not or were available, respectively. Measures of diagnostic accuracy were calculated using liver biopsy as the reference standard and compared between FIB-4, SWE, FIB-Net, and European Association for the Study of the Liver guidelines (ie, FIB-4 followed by SWE), along with sequential algorithms. Results The training, validation, and test data sets included 3067 (median age, 42 years [IQR, 33-53 years]; 2083 male), 1599 (median age, 41 years [IQR, 33-51 years]; 1124 male), and 1228 (median age, 44 years [IQR, 33-55 years]; 741 male) patients, respectively. FIB-Net obtained a noninferior specificity with a margin of 5% (P < .001) compared with SWE (80% vs 82%). The Two-step#1 algorithm showed higher specificity and positive predictive value (PPV) than FIB-4 (specificity, 79% vs 57%; PPV, 44% vs 32%) while reducing unnecessary referrals by 42%. The Three-step#1 algorithm had higher specificity and PPV compared with European Association for the Study of the Liver guidelines (specificity, 94% vs 88%; PPV, 73% vs 64%) while reducing unnecessary referrals by 35%. Conclusion A sequential algorithm combining FIB-4 and a US DL model showed higher diagnostic accuracy and improved referral management for all-cause advanced liver fibrosis compared with FIB-4 or the DL model alone. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Ghosh in this issue.

Collaborative Enhancement of Consistency and Accuracy in US Diagnosis of Thyroid Nodules Using Large Language Models.

Background Large language models (LLMs) hold substantial promise for medical imaging interpretation. However, there is a lack of studies on their feasibility in handling reasoning questions associated with medical diagnosis. Purpose To investigate the viability of leveraging three publicly available LLMs to enhance consistency and diagnostic accuracy in medical imaging based on standardized reporting, with pathology as the reference standard. Materials and Methods US images of thyroid nodules with pathologic results were retrospectively collected from a tertiary referral hospital between July 2022 and December 2022 and used to evaluate malignancy diagnoses generated by three LLMs-OpenAI's ChatGPT 3.5, ChatGPT 4.0, and Google's Bard. Inter- and intra-LLM agreement of diagnosis were evaluated. Then, diagnostic performance, including accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve (AUC), was evaluated and compared for the LLMs and three interactive approaches: human reader combined with LLMs, image-to-text model combined with LLMs, and an end-to-end convolutional neural network model. Results A total of 1161 US images of thyroid nodules (498 benign, 663 malignant) from 725 patients (mean age, 42.2 years ± 14.1 [SD]; 516 women) were evaluated. ChatGPT 4.0 and Bard displayed substantial to almost perfect intra-LLM agreement (κ range, 0.65-0.86 [95% CI: 0.64, 0.86]), while ChatGPT 3.5 showed fair to substantial agreement (κ range, 0.36-0.68 [95% CI: 0.36, 0.68]). ChatGPT 4.0 had an accuracy of 78%-86% (95% CI: 76%, 88%) and sensitivity of 86%-95% (95% CI: 83%, 96%), compared with 74%-86% (95% CI: 71%, 88%) and 74%-91% (95% CI: 71%, 93%), respectively, for Bard. Moreover, with ChatGPT 4.0, the image-to-text-LLM strategy exhibited an AUC (0.83 [95% CI: 0.80, 0.85]) and accuracy (84% [95% CI: 82%, 86%]) comparable to those of the human-LLM interaction strategy with two senior readers and one junior reader and exceeding those of the human-LLM interaction strategy with one junior reader. Conclusion LLMs, particularly integrated with image-to-text approaches, show potential in enhancing diagnostic medical imaging. ChatGPT 4.0 was optimal for consistency and diagnostic accuracy when compared with Bard and ChatGPT 3.5. © RSNA, 2024 Supplemental material is available for this article.

Integration of Artificial Intelligence Decision Aids to Reduce Workload and Enhance Efficiency in Thyroid Nodule Management.

Importance: To optimize the integration of artificial intelligence (AI) decision aids and reduce workload in thyroid nodule management, it is critical to incorporate personalized AI into the decision-making processes of radiologists with varying levels of expertise. Objective: To develop an optimized integration of AI decision aids for reducing radiologists' workload while maintaining diagnostic performance compared with traditional AI-assisted strategy. Design, Setting, and Participants: In this diagnostic study, a retrospective set of 1754 ultrasonographic images of 1048 patients with 1754 thyroid nodules from July 1, 2018, to July 31, 2019, was used to build an optimized strategy based on how 16 junior and senior radiologists incorporated AI-assisted diagnosis results with different image features. In the prospective set of this diagnostic study, 300 ultrasonographic images of 268 patients with 300 thyroid nodules from May 1 to December 31, 2021, were used to compare the optimized strategy with the traditional all-AI strategy in terms of diagnostic performance and workload reduction. Data analyses were completed in September 2022. Main Outcomes and Measures: The retrospective set of images was used to develop an optimized integration of AI decision aids for junior and senior radiologists based on the selection of AI-assisted significant or nonsignificant features. In the prospective set of images, the diagnostic performance, time-based cost, and assisted diagnosis were compared between the optimized strategy and the traditional all-AI strategy. Results: The retrospective set included 1754 ultrasonographic images from 1048 patients (mean [SD] age, 42.1 [13.2] years; 749 women [71.5%]) with 1754 thyroid nodules (mean [SD] size, 16.4 [10.6] mm); 748 nodules (42.6%) were benign, and 1006 (57.4%) were malignant. The prospective set included 300 ultrasonographic images from 268 patients (mean [SD] age, 41.7 [14.1] years; 194 women [72.4%]) with 300 thyroid nodules (mean [SD] size, 17.2 [6.8] mm); 125 nodules (41.7%) were benign, and 175 (58.3%) were malignant. For junior radiologists, the ultrasonographic features that were not improved by AI assistance included cystic or almost completely cystic nodules, anechoic nodules, spongiform nodules, and nodules smaller than 5 mm, whereas for senior radiologists the features that were not improved by AI assistance were cystic or almost completely cystic nodules, anechoic nodules, spongiform nodules, very hypoechoic nodules, nodules taller than wide, lobulated or irregular nodules, and extrathyroidal extension. Compared with the traditional all-AI strategy, the optimized strategy was associated with increased mean task completion times for junior radiologists (reader 11, from 15.2 seconds [95% CI, 13.2-17.2 seconds] to 19.4 seconds [95% CI, 15.6-23.3 seconds]; reader 12, from 12.7 seconds [95% CI, 11.4-13.9 seconds] to 15.6 seconds [95% CI, 13.6-17.7 seconds]), but shorter times for senior radiologists (reader 14, from 19.4 seconds [95% CI, 18.1-20.7 seconds] to 16.8 seconds [95% CI, 15.3-18.3 seconds]; reader 16, from 12.5 seconds [95% CI, 12.1-12.9 seconds] to 10.0 seconds [95% CI, 9.5-10.5 seconds]). There was no significant difference in sensitivity (range, 91%-100%) or specificity (range, 94%-98%) between the 2 strategies for readers 11 to 16. Conclusions and Relevance: This diagnostic study suggests that an optimized AI strategy in thyroid nodule management may reduce diagnostic time-based costs without sacrificing diagnostic accuracy for senior radiologists, while the traditional all-AI strategy may still be more beneficial for junior radiologists.

Shear-wave elastography combined with contrast-enhanced ultrasound algorithm for noninvasive characterization of focal liver lesions.

PURPOSE: To establish shear-wave elastography (SWE) combined with contrast-enhanced ultrasound (CEUS) algorithm (SCCA) and improve the diagnostic performance in differentiating focal liver lesions (FLLs). MATERIAL AND METHODS: We retrospectively selected patients with FLLs between January 2018 and December 2019 at the First Affiliated Hospital of Sun Yat-sen University. Histopathology was used as a standard criterion except for hemangiomas and focal nodular hyperplasia. CEUS with SonoVue (Bracco Imaging) and SCCA combining CEUS and maximum value of elastography with < 20 kPa and > 90 kPa thresholds were used for the diagnosis of FLLs. The diagnostic performance of CEUS and SCCA was calculated and compared. RESULTS: A total of 171 FLLs were included, with 124 malignant FLLs and 47 benign FLLs. The area under curve (AUC), sensitivity, and specificity in detecting malignant FLLs were 0.83, 91.94%, and 74.47% for CEUS, respectively, and 0.89, 91.94%, and 85.11% for SCCA, respectively. The AUC of SCCA was significantly higher than that of CEUS (P = 0.019). Decision curves indicated that SCCA provided greater clinical benefits. The SCCA provided significantly improved prediction of clinical outcomes, with a net reclassification improvement index of 10.64% (P = 0.018) and integrated discrimination improvement of 0.106 (P = 0.019). For subgroup analysis, we divided the FLLs into a chronic-liver-disease group (n = 88 FLLs) and a normal-liver group (n = 83 FLLs) according to the liver background. In the chronic-liver-disease group, there were no differences between the CEUS-based and SCCA diagnoses. In the normal-liver group, the AUC of SCCA and CEUS in the characterization of FLLs were 0.89 and 0.83, respectively (P = 0.018). CONCLUSION: SCCA is a feasible tool for differentiating FLLs in patients with normal liver backgrounds. Further investigations are necessary to validate the universality of this algorithm.

Performance and comparison of artificial intelligence and human experts in the detection and classification of colonic polyps.

OBJECTIVE: The main aim of this study was to analyze the performance of different artificial intelligence (AI) models in endoscopic colonic polyp detection and classification and compare them with doctors with different experience. METHODS: We searched the studies on Colonoscopy, Colonic Polyps, Artificial Intelligence, Machine Learning, and Deep Learning published before May 2020 in PubMed, EMBASE, Cochrane, and the citation index of the conference proceedings. The quality of studies was assessed using the QUADAS-2 table of diagnostic test quality evaluation criteria. The random-effects model was calculated using Meta-DISC 1.4 and RevMan 5.3. RESULTS: A total of 16 studies were included for meta-analysis. Only one study (1/16) presented externally validated results. The area under the curve (AUC) of AI group, expert group and non-expert group for detection and classification of colonic polyps were 0.940, 0.918, and 0.871, respectively. AI group had slightly lower pooled specificity than the expert group (79% vs. 86%, P < 0.05), but the pooled sensitivity was higher than the expert group (88% vs. 80%, P < 0.05). While the non-experts had less pooled specificity in polyp recognition than the experts (81% vs. 86%, P < 0.05), and higher pooled sensitivity than the experts (85% vs. 80%, P < 0.05). CONCLUSION: The performance of AI in polyp detection and classification is similar to that of human experts, with high sensitivity and moderate specificity. Different tasks may have an impact on the performance of deep learning models and human experts, especially in terms of sensitivity and specificity.

Identification of the origin of tumor in vein: comparison between CEUS LI-RADS v2017 and v2016 for patients at high risk.

OBJECTIVES: To compare the diagnostic performance of the Contrast-Enhanced Ultrasound (CEUS) Liver Imaging Report and Data System (LI-RADS) v2016 and v2017 in identifying the origin of tumor in vein (TIV). METHODS: From April 2014 to December 2018, focal liver lesions (FLLs) accompanied by TIV formation in patients at high risk for hepatocellular carcinoma (HCC) were enrolled. Histologic evaluation or composite imaging reference standard were served as the reference standard. Each case was categorized according to the CEUS LI-RADS v2016 and v2017, respectively. Diagnostic performance of CEUS LI-RADS v2016 and v2017 in identifying the originated tumor of TIV was validated via sensitivity, specificity, accuracy, positive predictive value (PPV) and negative predictive value. RESULTS: A total of 273 FLLs with TIV were analyzed finally, including 266 HCCs and 7 non-HCCs. In v2016, when adopting all TIV as LR-5V, the accuracy and PPV in identifying the originated tumor were both 97.4%. In v2017, when assigning TIV according to contiguous FLLs CEUS LI-RADS category, the accuracy and PPV were 61.9% and 99.4% in subclass of LR-5 as the diagnostic criteria of HCC, and 64.1% and 99.4% in subclass of LR-4/5 as the criteria of HCC diagnosis. There were significant differences in diagnostic accuracy between CEUS LI-RADS v2016 and v2017 in identifying the originated tumor of TIV (p < 0.001). CONCLUSIONS: CEUS LI-RADS v2016 could be better than v2017 in identifying the originated tumor of TIV.

Circulating tumour cell counts and ultrasomics signature-based nomogram for preoperative prediction of early recurrence of hepatocellular carcinoma after radical treatment.

METHODS: Between December 2017 and December 2018, 153 HCC patients (134 males and 19 females; mean age, 56.0 ± 10.2 years; range, 28-78 years) treated with radical therapy were enrolled in our retrospective study and were divided into a training cohort (n = 107) and a validation cohort (n = 46). All patients underwent preoperative CTC tests and CEUS examinations before treatment. The ultrasomics signature was extracted and built from CEUS images. Univariate and multivariate logistic regression analyses were used to identify the significant variables related to ER, which were then combined to build a predictive nomogram. The performance of the nomogram was evaluated by its discrimination, calibration and clinical utility. The predictive model was further evaluated in the internal validation cohort. RESULTS: HBV DNA, serum AFP level, CTC status, tumour size and ultrasomics score were identified as independent predictors associated with ER (all p < 0.05). Multivariable logistic regression analysis showed that the CTC status (OR = 7.02 [95% CI, 2.07 to 28.38], p = 0.003) and ultrasomics score (OR = 148.65 [95% CI, 25.49 to 1741.72], p < 0.001) were independent risk factors for ER. The nomogram based on ultrasomics score, CTC status, serum AFP level and tumour size exhibited C-indexes of 0.933 (95% CI, 0.878 to 0.988) and 0.910 (95% CI, 0.765 to 1.055) in the training and validation cohorts, respectively, fitting well in calibration curves. Decision curve analysis further confirmed the clinical usefulness of the nomogram. CONCLUSION: The nomogram incorporating CTC, ultrasomics features and independent clinical risk factors achieved satisfactory preoperative prediction of ER in HCC patients after radical treatment. ADVANCES IN KNOWLEDGE: 1. CTC status and ultrasomics score were identified as independent predictors associated with ER of HCC after radical treatment. 2. The nomogram constructed by ultrasomics score generated by 17 ultrasomics features, combined with CTCs and independent clinical risk factors such as AFP and tumour size. 3. The nomogram exhibited satisfactory discriminative power, and could be clinically useful in the preoperative prediction of ER after radical treatment in HCC patients.

Application of the CT/MRI LI-RADS Treatment Response Algorithm to Contrast-Enhanced Ultrasound: A Feasibility Study.

Purpose: The contrast-enhanced ultrasound (CEUS) Liver Imaging Reporting and Data System (LI-RADS) treatment response algorithm (TRA) is still in development. The aim of this study was to explore whether the CT/MRI LI-RADS TRA features were applicable to CEUS in evaluating the liver locoregional therapy (LRT) response. Patients and Methods: This study was a retrospective review of a prospectively maintained database of patients with hepatocellular carcinoma undergoing ablation between July 2017 and December 2018. The standard criteria for a viable lesion were a histopathologically confirmed or typical viable appearance in the follow-up CT/MRI. Performance of the LI-RADS TRA assessing tumor viability was then compared between CEUS and CT/MRI. Inter-reader association was calculated. Results: A total of 244 patients with 389 treated observations (118 viable) were evaluated. The sensitivity and specificity of the CEUS TRA and CT/MRI LI-RADS TRA viable categories for predicting viable lesions were 55.0% (65/118) versus 56.8% (67/118) (P = 0.480) and 99.3% (269/271) versus 96.3% (261/271) (P = 0.013), respectively. The PPV of CEUS was higher than that of CT/MRI (97.0% vs 87.0%). Subgroup analysis showed that the sensitivity was low in the 1-month assessment for both CEUS (38.1%, 16/42) and CT/MR (47.6%, 20/42) and higher in the 2-6-month assessment for both CEUS (65.7%, 23/35) and CT/MR (62.9%, 22/35). Interobserver agreements were substantial for both CEUS TRA and CT/MRI LI-RADS TRA (κ, 0.74 for both). Conclusion: The CT/MRI LI-RADS TRA features were applicable to CEUS TRA for liver locoregional therapy. The CEUS TRA for liver locoregional therapy has sufficiently high specificity and PPV to diagnose the viability of lesions after ablation.

Reproducibility of radiomics features from ultrasound images: influence of image acquisition and processing.

OBJECTIVES: To systematically assess the reproducibility of radiomics features from ultrasound (US) images during image acquisition and processing. MATERIALS AND METHODS: A standardized phantom was scanned to obtain US images. Reproducibility of radiomics features from US images, also known as ultrasomics features, was explored via (a) intra-US machine: changing the US acquisition parameters including gain, focus, and frequency; (b) inter-US machine: comparing three different scanners; (c) changing segmentation locations; and (d) inter-platform: comparing features extracted by the Ultrasomics and PyRadiomics algorithm platforms. Reproducible ultrasomics features were selected based on coefficients of variation. RESULTS: A total of 108 US images from three scanners were obtained; 5253 ultrasomics features including seven categories of features were extracted and evaluated for each US image. From intra-US machine analysis, 37.0-38.8% of features showed good reproducibility. From inter-US machine analysis, 42.8% (2248/5253) of features exhibited good reproducibility. From segmentation location analysis, 55.7-57.6% of features showed good reproducibility. No significant difference in the normalized feature ranges was found between the 100 features extracted by the Ultrasomics and PyRadiomics platforms with the same algorithm (p = 0.563). A total of 1452 (27.6%) ultrasomics features were reproducible whenever intra-/inter-US machine or segmentation location were changed, most of which were wavelet and shearlet features. CONCLUSIONS: Different acquisition parameters, US scanners, segmentation locations, and feature extraction platforms affected the reproducibility of ultrasomics features. Wavelet and shearlet features showed the best reproducibility across all procedures. KEY POINTS: • Different acquisition parameters, US scanners, segmentation locations, and feature extraction platforms affected the reproducibility of ultrasomics features. • A total of 1452 (27.6%) ultrasomics features were reproducible whenever intra-/inter-US machine or segmentation location were changed. • Wavelet and shearlet features showed the best reproducibility across all procedures.

An assessment of liver lesions using a combination of CEUS LI-RADS and AFP.

PURPOSE: To improve noninvasive diagnosis of HCC using a combination of CE US LI-RADS and alpha-fetoprotein (AFP). METHODS: 757 solitary liver nodules from 757 patients at risk of HCC with CE US and serum AFP test were categorized as LR-1 to LR-5 through LR-M according to CE US LI-RADS version 2017. In LR-3, LR-4, and LR-M nodules, those with AFP > 200 ng/ml were reclassified as mLR-5. Nodules with LR-5 and mLR-5 were reclassified as definitely HCC to modify CE US LI-RADS. Diagnostic performance was assessed with specificity, sensitivity, and PPV. RESULTS: The sensitivity, specificity, and PPV of LR-5 as a predictor of HCC were 64.7%, 97.8%, and 98.9%, respectively. 32.1% patients with solitary liver nodule had AFP greater than 200 ng/ml, of which 98.8% were HCC (25.8%, 7.5%, 2.5% assigned to LR-M, LR-4, LR-3, respectively) and 1.2% were Combined Hepatocellular Cholangiocarcinoma. After modification, the sensitivity increased to 79.6% (P < 0.001), while specificity and PPV remained high (96.6% and 98.7%, P > 0.050). CONCLUSION: The combination of CE US LI-RADS and AFP for diagnosing HCC improved diagnostic sensitivity significantly, while maintaining high PPV and specificity in patients with the solitary liver nodule.

Contrast-Enhanced Ultrasound-Based Nomogram: A Potential Predictor of Individually Postoperative Early Recurrence for Patients With Combined Hepatocellular-Cholangiocarcinoma.

PURPOSES: To evaluate the postsurgical prognostic implication of contrast-enhanced ultrasound (CEUS) for combined hepatocellular-cholangiocarcinoma (CHC). To build a CEUS-based early recurrence prediction classifier for CHC, in comparison with tumor-node-metastasis (TNM) staging. METHODS: The CEUS features and clinicopathological findings of each case were analyzed, and the Liver Imaging Reporting and Data System categories were assigned. The recurrence-free survival associated factors were evaluated by Cox proportional hazard model. Incorporating the independent factors, nomograms were built to estimate the possibilities of 3-month, 6-month, and 1-year recurrence and whose prognostic value was determined by time-dependent receiver operating characteristics, calibration curves, and hazard layering efficiency validation, comparing with TNM staging system. RESULTS: In the multivariable analysis, the levels of carbohydrate antigen 19-9, prothrombin time and total bilirubin, and tumor shape, the Liver Imaging Reporting and Data System category were independent factors for recurrence-free survival. The LR-M category showed longer recurrence-free survival than did the LR-4/5 category. The 3-month, 6-month, and 1-year area under the curves of the CEUS-clinical nomogram, clinical nomogram, and TNM staging system were 0.518, 0.552, and 0.843 versus 0.354, 0.240, and 0.624 (P = .048, .049, and .471) vs. 0.562, 0.545, and 0.843 (P = .630, .564, and .007), respectively. The calibration curves of the CEUS-clinical model at different prediction time pionts were all close to the ideal line. The CEUS-clinical model effectively stratified patients into groups of high and low risk of recurrence in both training and validation set, while the TNM staging system only works on the training set. CONCLUSIONS: Our CEUS-clinical nomogram is a reliable early recurrence prediction tool for hepatocellular-cholangiocarcinoma and helps postoperative risk stratification.

Using new criteria to improve the differentiation between HCC and non-HCC malignancies: clinical practice and discussion in CEUS LI-RADS 2017.

PURPOSE: Using contrast-enhanced ultrasound (CEUS) to evaluate the diagnostic performance of liver imaging reporting and data system (LI-RADS) version 2017 and to explore potential ways to improve the efficacy. METHODS: A total of 315 nodules were classified as LR-1 to LR-5, LR-M, and LR-TIV. New criteria were applied by adjusting the early washout onset (< 45 s) and the time of marked washout (within 3 min). Two subgroups of the LR-M nodules were recategorized as LR-5, respectively. The diagnostic performance was evaluated by calculating the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). RESULTS: By adjusting early washout onset to < 45 s, the LR-5 as a standard for diagnosing HCC had an improved sensitivity (74.1% vs. 56.1%, P < 0.001) without significant change in PPV (93.3% vs. 96.1%, P = 0.267), but the specificity was decreased (48.3% vs. 78.5%, P = 0.018). The LR-M as a standard for the diagnosis of non-HCC malignancies had an increase in specificity (89.2% vs. 66.2%, P < 0.001) but a decrease in sensitivity (31.5% vs. 68.4%, P = 0.023). After reclassification according to the time of marked washout, the sensitivity of the LR-5 increased (80% vs. 56.1%, P < 0.001) without a change in PPV (94.9% vs. 96.1%, P = 0.626) and specificity (80% vs. 78.5%, P = 0.879). For reclassified LR-M nodules, the specificity increased (87.5% versus 66.2%, P < 0.001) with a non-significant decrease in sensitivity (47.3% vs. 68.4%, P = 0.189). CONCLUSIONS: The CEUS LI-RADS showed good confidence in diagnosing HCC while tended to misdiagnose HCC as non-HCC malignancies. Adjusting the marked washout time within 3 min would reduce the possibility of this misdiagnosis.

Contrast-enhanced ultrasound-based ultrasomics score: a potential biomarker for predicting early recurrence of hepatocellular carcinoma after resection or ablation.

OBJECTIVES: This study aimed to construct a prediction model based on contrast-enhanced ultrasound (CEUS) ultrasomics features and investigate its efficacy in predicting early recurrence (ER) of primary hepatocellular carcinoma (HCC) after resection or ablation. METHODS: This study retrospectively included 215 patients with primary HCC, who were divided into a developmental cohort (n = 139) and a test cohort (n = 76). Four representative images-grayscale ultrasound, arterial phase, portal venous phase and delayed phase-were extracted from each CEUS video. Ultrasomics features were extracted from tumoral and peritumoral area inside the region of interest. Logistic regression was used to establish models, including a tumoral model, a peritumoral model and a combined model with additional clinical risk factors. The performance of the three models in predicting recurrence within 2 years was verified. RESULTS: The combined model performed best in predicting recurrence within 2 years, with an area under the curve (AUC) of 0.845, while the tumoral model had an AUC of 0.810 and the peritumoral model one of 0.808. For prediction of recurrence-free survival, the 2-year cumulative recurrence rate was significant higher in the high-risk group (76.5%) than in the low-risk group (9.5%; p < 0.0001). CONCLUSION: These CEUS ultrasomics models, especially the combined model, had good efficacy in predicting early recurrence of HCC. The combined model has potential for individual survival assessment for HCC patients undergoing resection or ablation. ADVANCES IN KNOWLEDGE: CEUS ultrasomics had high sensitivity, specificity and PPV in diagnosing early recurrence of HCC, and high efficacy in predicting early recurrence of HCC (AUC > 0.8). The combined model performed better than the tumoral ultrasomics model and peritumoral ultrasomics model in predicting recurrence within 2 years. Recurrence was more likely to occur in the high-risk group than in the low-risk group, with 2-year cumulative recurrence rates, respectively, 76.5% and 9.5% (p < 0.0001).

RGB Three-Channel SWE-Based Ultrasomics Model: Improving the Efficiency in Differentiating Focal Liver Lesions.

OBJECTIVE: To explore a new method for color image analysis of ultrasomics and investigate the efficiency in differentiating focal liver lesions (FLLs) by Red, Green, and Blue (RGB) three-channel SWE-based ultrasomics model. METHODS: One hundred thirty FLLs were randomly divided into training set (n = 65) and validation set (n = 65). The RGB three-channel and direct conversion methods were applied to the same color SWE images. Ultrasomics features were extracted from the preprocessing images establishing two feature data sets. The least absolute shrinkage and selection operator (LASSO) logistic regression model was applied for feature selection and model construction. Two models, named RGB model (based on RGB three-channel conversion) and direct model (based on direct conversion), were used to differentiate FLLs. The diagnosis performance of the two models was evaluated by area under the curve (AUC), calibration curves, decision curves, and net reclassification index (NRI). RESULTS: In the validation cohort, the AUC of the direct model and RGB model in characterization on FLLs were 0.813 and 0.926, respectively (p = 0.038). Calibration curves and decision curves indicated that the RGB model had better calibration efficiency and provided greater clinical benefits. NRI revealed that the RGB model correctly reclassified 7% of malignant cases and 25% of benign cases compared to the direct model (p = 0.01). CONCLUSION: The RGB model generated by RGB three-channel method yielded better diagnostic efficiency than the direct model established by direct conversion method. The RGB three-channel method may be promising on ultrasomics analysis of color images in clinical application.

Tumor size-based validation of contrast-enhanced ultrasound liver imaging reporting and data system (CEUS LI-RADS) 2017 for hepatocellular carcinoma characterizing.

OBJECTIVES: To validate the efficacy of contrast-enhanced ultrasound Liver Imaging Reporting and Data System (CEUS LI-RADS) and its major features in diagnosing hepatocellular carcinoma (HCC) of different sizes in high-risk patients. METHODS: Between January 2014 and December 2015, a total of 545 untreated liver nodules were included. These liver nodules were divided into two groups (<20 mm and ≥20 mm). Each nodule was classified based on CEUS LI-RADS. The diagnostic performance comparison was assessed by the chi-square test, with pathology results as the golden criterion. RESULTS: The accuracy, sensitivity, specificity, and positive predictive value (PPV) of CEUS LR-5 criteria in <20 mm group vs ≥20 mm group in diagnosing HCC were 60.5% vs 59.8%, 55.6% vs 57.6%, 85.7% vs 88.6 and 95.2% vs 98.5%, respectively, without significant difference (all p > 0.05). The accuracy, sensitivity and PPV of LR5/M for malignancy in <20 mm group were lower than in ≥20 mm group, with values of 79.1% vs 95.0%, 84.2% vs 95.7 and 91.4% vs 99.2%, respectively (p < 0.05). CONCLUSIONS: The CEUS LI-RADS has a comparable performance for diagnosing HCC between lesions ≥ 20 mm and <20 mm. For diagnosing malignancy including HCC, it has a higher efficacy for lesions ≥ 20 mm than <20 mm. ADVANCES IN KNOWLEDGE: 1.For diagnosing HCC, CEUS LI-RADS has comparable performances between lesions ≥ 20 mm and <20 mm.2. For diagnosing malignancy including HCC, CEUS LI-RADS has a higher efficacy for lesions ≥ 20 mm than <20 mm.

Articles That Use Artificial Intelligence for Ultrasound: A Reader's Guide.

Artificial intelligence (AI) transforms medical images into high-throughput mineable data. Machine learning algorithms, which can be designed for modeling for lesion detection, target segmentation, disease diagnosis, and prognosis prediction, have markedly promoted precision medicine for clinical decision support. There has been a dramatic increase in the number of articles, including articles on ultrasound with AI, published in only a few years. Given the unique properties of ultrasound that differentiate it from other imaging modalities, including real-time scanning, operator-dependence, and multi-modality, readers should pay additional attention to assessing studies that rely on ultrasound AI. This review offers the readers a targeted guide covering critical points that can be used to identify strong and underpowered ultrasound AI studies.

Machine Learning-Based Ultrasomics Improves the Diagnostic Performance in Differentiating Focal Nodular Hyperplasia and Atypical Hepatocellular Carcinoma.

BACKGROUND: The typical enhancement patterns of hepatocellular carcinoma (HCC) on contrast-enhanced ultrasound (CEUS) are hyper-enhanced in the arterial phase and washed out during the portal venous and late phases. However, atypical variations make a differential diagnosis both challenging and crucial. We aimed to investigate whether machine learning-based ultrasonic signatures derived from CEUS images could improve the diagnostic performance in differentiating focal nodular hyperplasia (FNH) and atypical hepatocellular carcinoma (aHCC). PATIENTS AND METHODS: A total of 226 focal liver lesions, including 107 aHCC and 119 FNH lesions, examined by CEUS were reviewed retrospectively. For machine learning-based ultrasomics, 3,132 features were extracted from the images of the baseline, arterial, and portal phases. An ultrasomics signature was generated by a machine learning model. The predictive model was constructed using the support vector machine method trained with the following groups: ultrasomics features, radiologist's score, and combination of ultrasomics features and radiologist's score. The diagnostic performance was explored using the area under the receiver operating characteristic curve (AUC). RESULTS: A total of 14 ultrasomics features were chosen to build an ultrasomics model, and they presented good performance in differentiating FNH and aHCC with an AUC of 0.86 (95% confidence interval [CI]: 0.80, 0.89), a sensitivity of 76.6% (95% CI: 67.5%, 84.3%), and a specificity of 80.5% (95% CI: 70.6%, 85.9%). The model trained with a combination of ultrasomics features and the radiologist's score achieved a significantly higher AUC (0.93, 95% CI: 0.89, 0.96) than that trained with the radiologist's score (AUC: 0.84, 95% CI: 0.79, 0.89, P < 0.001). For the sub-group of HCC with normal AFP value, the model trained with a combination of ultrasomics features, and the radiologist's score remain achieved the highest AUC of 0.92 (95% CI: 0.87, 0.96) compared to that with the ultrasomics features (AUC: 0.86, 95% CI: 0.74, 0.89, P < 0.001) and radiologist's score (AUC: 0.86, 95% CI: 0.79, 0.91, P < 0.001). CONCLUSIONS: Machine learning-based ultrasomics performs as well as the staff radiologist in predicting the differential diagnosis of FNH and aHCC. Incorporating an ultrasomics signature into the radiologist's score improves the diagnostic performance in differentiating FNH and aHCC.

Artificial intelligence assists identifying malignant versus benign liver lesions using contrast-enhanced ultrasound.

BACKGROUND AND AIM: This study aims to construct a strategy that uses assistance from artificial intelligence (AI) to assist radiologists in the identification of malignant versus benign focal liver lesions (FLLs) using contrast-enhanced ultrasound (CEUS). METHODS: A training set (patients = 363) and a testing set (patients = 211) were collected from our institute. On four-phase CEUS images in the training set, a composite deep learning architecture was trained and tuned for differentiating malignant and benign FLLs. In the test dataset, AI performance was evaluated by comparison with radiologists with varied levels of experience. Based on the comparison, an AI assistance strategy was constructed, and its usefulness in reducing CEUS interobserver heterogeneity was further tested. RESULTS: In the test set, to identify malignant versus benign FLLs, AI achieved an area under the curve of 0.934 (95% CI 0.890-0.978) with an accuracy of 91.0%. Comparing with radiologists reviewing videos along with complementary patient information, AI outperformed residents (82.9-84.4%, P = 0.038) and matched the performance of experts (87.2-88.2%, P = 0.438). Due to the higher positive predictive value (PPV) (AI: 95.6% vs residents: 88.6-89.7%, P = 0.056), an AI strategy was defined to improve the malignant diagnosis. With the assistance of AI, radiologists exhibited a sensitivity improvement of 97.0-99.4% (P < 0.05) and an accuracy of 91.0-92.9% (P = 0.008-0.189), which was comparable with that of the experts (P = 0.904). CONCLUSIONS: The CEUS-based AI strategy improved the performance of residents and reduced CEUS's interobserver heterogeneity in the differentiation of benign and malignant FLLs.

Inter-reader agreement of CEUS LI-RADS among radiologists with different levels of experience.

OBJECTIVES: To investigate the inter-reader agreement of contrast-enhanced ultrasound (CEUS) of Liver Imaging Reporting and Data System version 2017 (LI-RADS v2017) categories among radiologists with different levels of experience. MATERIALS AND METHODS: From January 2014 to December 2014, a total of 326 patients at high risk of hepatocellular carcinoma (HCC) who underwent CEUS were included in this retrospective study. All lesions were classified according to LI-RADS v2017 by six radiologists with different levels of experiences: two residents, two fellows, and two specialists. Kappa coefficient was used to assess consistency of LI-RADS categories and major features among radiologists with different levels of experience. The diagnostic performance of HCC was described by accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the curve (AUC). RESULTS: Inter-reader agreement among radiologists of different experience levels was substantial agreement for arterial phase hyperenhancement, washout appearance, and early or late washout. Inter-reader agreement for LI-RADS categories was moderate to substantial. When LR-5 was used as criteria to determinate HCC, the AUC of LI-RADS for HCC was 0.67 for residents, 0.72 for fellows, and 0.78 for specialist radiologists. When compared between residents and specialists, accuracy, sensitivity, and AUC were significantly different (all p < 0.05). However, there were no significant differences in specificity, PPV, and NPV between the two groups. CONCLUSION: CEUS LI-RADS showed good diagnostic consistency among radiologists with different levels of experience, and consistency increased with experience levels. KEY POINTS: • The inter-reader agreement for LI-RADS categories was moderate to substantial agreement (κ, 0.60-0.80). • When compared between residents and specialists, accuracy, sensitivity, and AUC showed significantly different (all p < 0.05). However, there were no significant differences for specificity, PPV, and NPV between these two groups. • Among the radiologists with more than 1 year of experience, there was no significant difference in the diagnostic performance of HCC, suggesting that CEUS LI-RADS is a good standardized categorization system for high-risk patients.

Preliminary investigation of the diagnostic value of shear wave elastography in evaluating the testicular spermatogenic function in patients with azoospermia.

To assess the diagnostic value of shear wave elastography (SWE) for evaluating the histological spermatogenic function of azoospermic males, 91 patients with azoospermia who underwent standardised greyscale ultrasound and SWE examinations followed by testicular biopsy were retrospectively recruited. Spermatogenic function was classified by biopsy as normal testicular spermatogenesis (n = 61), hypospermatogenesis (n = 18), spermatogenesis arrest (n = 6) and Sertoli cell-only syndrome (n = 6). Significant differences in testicular size and SWE values were observed between these 4 groups (p < .01). The mean SWE value had good discrimination power (AUC = 0.79) with a cut-off value of 1.55 KPa, a sensitivity of 0.58, specificity of 0.85, positive predictive value (PPV) of 0.36 and negative predictive value (NPV) of 0.93. Testicular volume had an AUC of 0.75. With a cut-off value of 8.41 ml, the testicular volume had a sensitivity of 0.58, specificity of 0.92, PPV of 0.54 and NPV of 0.93. The mean SWE value and testicular volume efficiently discriminated patients with normal spermatogenesis and hypospermatogenesis from patients with Sertoli cell-only syndrome and spermatogenesis arrest.